Empirical assessment of bias in machine learning diagnostic test accuracy studies

Studies of diagnostic test accuracy

Definition of a diagnostic test accuracy study? o A diagnostic test accuracy study evaluates the accuracy of index test in correctly distinguishing between those with disease and those without disease compared to gold standard test. o Gold standard test is also called criterion test or reference test. o For a diagnostic test to be accurate, it should be both valid (accuracy) and reliable (preci...

Automatic machine-learning based identification of diagnostic test accuracy studies for systematic reviews

This study evaluates several machine-learning based approaches for identifying diagnostic test accuracy studies within a large set of scientific articles for the purpose of reducing the workload of researchers when manually screening abstracts to be utilized in systematic reviews. The relative performance was measured between three documents representation models, with different degrees of rand...

Meta-analysis of Diagnostic Test Accuracy Studies

Evidence of bias and variation in diagnostic accuracy studies.

BACKGROUND Studies with methodologic shortcomings can overestimate the accuracy of a medical test. We sought to determine and compare the direction and magnitude of the effects of a number of potential sources of bias and variation in studies on estimates of diagnostic accuracy. METHODS We identified meta-analyses of the diagnostic accuracy of tests through an electronic search of the databas...

Understanding sources of bias in diagnostic accuracy studies.

CONTEXT Accuracy is an important feature of any diagnostic test. There has been an increasing awareness of deficiencies in study design that can create bias in estimates of test accuracy. Many pathologists are unaware of these sources of bias. OBJECTIVE To explain the causes and increase awareness of several common types of bias that result from deficiencies in the design of diagnostic accura...